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Abstract 

In this paper we study a substantial generalization of the model of excited random walk 
introduced in 2003 by Benjamini and Wilson. We consider a discrete-time stochastic process 
(X n , n = 0, 1, 2, . . .) taking values on Z d , d > 2, described as follows: when the particle visits a site 
for the first time, it has a uniformly positive drift in a given direction £; when the particle is at a 
site which was already visited before, it has zero drift. Assuming uniform ellipticity and that the 
jumps of the process are uniformly bounded, we prove that the process is ballistic in the direction I 
so that lim inf n-yoc > 0. A key ingredient in the proof of this result is an estimate on the 
probability that the process visits less than n^ +a distinct sites by time n, where a is some positive 
number depending on the parameters of the model. This approach completely avoids the use of 
tan points and coupling methods specific to the excited random walk. Furthermore, we apply this 
technique to prove that the excited random walk in an i.i.d. random environment satisfies a ballistic 
law of large numbers and a central limit theorem. 
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1 Introduction and results 

Let p € (1/2,1]. Consider two discrete time simple random walks on the hyper-cubic lattice 
d > 2: a symmetric random walk (Y n ,n > 0) and a random walk (Z n ,n > 0) which jumps to the 
right with probability p/d, to the left with probability (1 — p)/d and to the other nearest neighbor 
sites with probability l/(2d). The excited or cookie random walk with bias parameter p on Z rf is a 
self-interacting random walk (X n ,n > 0) starting from and defined as follows: if at time n the walk 
is at a site x which it visited at some time k such that k < n, it jumps according to the transition 
probabilities of the symmetric random walk (Y n ), so that it jumps with probability l/(2d) to the 
nearest neighbor sites of x; if at time n the process visits a site x for the first time, it jumps according 
to the transition probabilities of the walk (Z n ), so that it jumps to the right with probability p/d, to 
the left with probability (l—p)/d and to the other nearest neighbor sites of x with probability 1 / (2d) 
(eating one cookie at site x). We will call the walks (Y n ) and (Z n ) defining the excited random walk, 
the underlying processes of the excited random walk. 
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The excited random walk was introduced in 2003 by Benjamini and Wilson in [3j. They proved 
that for dimensions d > 2 it is transient to the right, meaning that a.s. 

lim X n • ei = oo, (1.1) 

n— >oo 

where {ej : 1 < i < d} denote the canonical generators of the additive group Z rf . Furthermore, they 
showed that in dimensions d > 4 the excited random walk is ballistic to the right so that a.s. 

liminf^HlEl >0 . (1.2) 

n— >oo n 

In [10] and |11| . Kozma extended the above ballisticity result to dimensions d = 3 and d = 2. Standard 
methods based on regeneration times can be used to deduce from (|1.2|) that a law of large numbers 
with deterministic speed v is satisfied, so that a.s. 

,. X n 

lim — = v, 

n— >co TL 

where v ■ e\ > and v ■ ej = for 2 < j < n. In [4J, Berard and Ramirez gave an alternative proof of 
ballisticity and proved that a central limit theorem is satisfied in dimensions d > 2, so that 

e l/2 (X £ -i n -e^nv), (1.3) 

converges in law as e — > to a Brownian motion with variance a 2 > 0. A variant of the excited 
random walk, called the multi-excited random walk, was introduced by Zerner in [15] . where the walk 
has the possibility of consuming more than one cookie per site, and hence the process exhibits a non- 
trivial behavior even in dimension d = 1. Several papers have been written where the transient and 
ballisticity properties of this model are studied in random and deterministic environments, mainly in 
dimension d = 1 (see for example [Hi El [2]). Nevertheless, with the exception of [7] and |16| . a very 
natural issue has not been so far addressed: what happens if the underlying processes are no longer 
nearest-neighbor spatially homogeneous random walks? For example, if (Y n ) and (Z n ) are random 
walks on "L d which are not spatially homogeneous and do not perform nearest neighbor jumps, (Y n ) 
has zero drift and (Z n ) has a drift to the right, is the corresponding excited random walk transient 
to the right? It is reasonable to wonder under which conditions the corresponding excited random 
walk would still be transient to the right as in ballistic as in (|1.2|) . or satisfy a central limit 

theorem as in (|1.3p . In this paper, we study a generalization of the excited random walk on Z rf , d > 2, 
where the underlying process of the model are not necessarily homogeneous random walks, or not even 
Markovian. 

From our point of view, part of the reason why these issues have not been considered, is related to 
the techniques so far developed to study the many-dimensional excited random walk. Indeed, the proof 
of transience to the right of [3], the ballisticity-law of large numbers and the central limit theorem 
of [1] in dimensions d > 2, rest on the following two key ingredients: (i) the excited random walk can 
be coupled to the underlying simple symmetric random walk (Y n ), in such a way that (X n — Y n ) ■ e\ 
is nondecreasing in n and (X n — Y n ) ■ ej = for every 2 < j < d; (ii) it is possible to get a lower 
bound for the cardinality of the range at time n of the excited random walk in terms of the tan points 
of the coupled simple symmetric random walk, which exploit reversibility properties of the symmetric 
random walk (see [3] and [5]). A tan point of the random walk (Y n ) in dimension d = 2 is defined as any 
site x € Z 2 with the property that the ray {x + ke\ : k > 0} is visited by the random walk for the first 
time at site x. As explained in [3], it can be shown using the ideas of [3] that for every e the number 
of tan points visited by (Y m ) at time n is larger than n 3 / 4_e with a probability that decays faster than 
any polynomial in n. Notwithstanding, these methods break down when the underlying processes are 
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even slightly modified. On one hand, the coupling between the excited random walk and the simple 
random walk does not work in general. Furthermore, the estimation of the number of tan points at a 
given time is a very specific argument which works only for simple symmetric random walks. Hence, 
to study excited random walks defined in terms of more general underlying processes, more powerful 
methods have to be developed: a fundamental ingredient of this paper, is the introduction of a new 
technique to estimate the range of general versions of excited random walks, which completely avoids 
the use of tan points. 

We define a generalized excited random walk which will correspond to a process driven by an 
underlying process (Y n ) which is a (cf-dimensional) martingale and a process (Z n ) which satisfies 
minimal requirements, including the presence of a drift. We develop a machinery which avoids the 
use of tan points and of coupling, proving that this generalized excited random walk is ballistic. Let 
|| • || be the L 2 -norm in Z rf or R d , d > 2; also, we define S rf_1 = {x G R d : ||x|| = 1} to be the unit 
sphere in M d . Consider a Z d - valued stochastic process X = (X n ,n = 0, 1, 2, . . .) adapted to a filtration 
J 7 = {Fm n = 0, 1, 2, . . .). Unless otherwise stated, we suppose that Xq = 0. Denote by P the law of X 
and by E the corresponding expectation. As mentioned before, the processes we are considering are 
known also as cookie random walks. This terminology is also useful to us, because in the sequel we 
will need to consider situations when the particle gets the first visit push not in all the sites, but only 
in the sites of some fixed subset of Z rf . In this case, we say that the initial configuration of cookies (or 
the initial cookie environment) is such that they are only in this set. 

Throughout the paper we suppose that the jumps of the process are uniformly bounded, i.e., the 
following condition holds for the process X: 

Condition B. There exists a constant K > such that sup n>0 H-^n+i — Xn\\ — K a - s - 

Next, consider the following condition: 

Condition C + . Let £ G S" — 1 . We say that Condition C + is satisfied with respect to £ if there exist 
a A > such that 

E(A n+ i — X n | J- n ) = on {there exists k < n such that Xk = X n }, 

and 

E(X n+ i - X n | T n ) ■ £ > A on {X k ± X n for all k < n}. 

The meaning of Condition C + is that, when the process X visits a site for the first time, it has drift 
in the direction £, whereas if it comes to an already visited site, it has zero drift behaving like a 
martingale. 

Also, we formulate 

Condition E. Let i € S . We say that Condition E is satisfied with respect to I if there exist h,r > 
such that for all n 

F[(X n+1 - X n ) ■ £ > r | T n ] > h (1.4) 
and for all £' with ||^|| = 1, on {E(A n+ i - X n \ F n ) = 0} 

F[(X n+1 - X n ) ■ £' > r | T n ] > h. (1.5) 

Condition E is a kind of uniform ellipticity assumption, which states that the process can always 
advance in the direction £ by a uniformly positive amount with a uniformly positive probability, 
and also, when the local drift is equal to zero, the process can do so in any direction. In fact, one 
may easily verify that if the Conditions B and C + are satisfied, then automatically (jl.4|) holds for 
some positive h, r. However, we still formulate Condition E this way because in the sequel we will 
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need also to consider processes where the first visit push is not necessarily uniformly positive. Now, 
given £ G § rf_1 , any stochastic process X adapted to a filtration J 7 , which satisfies Condition B and 
Conditions C + and E with respect to £, will be called a generalized excited random walk in direction £. 
Note that the standard excited random walk with its natural filtration is a generalized random walk 
in direction e%. The first result of this paper is that any generalized excited random walk is ballistic. 

Theorem 1.1 Let d > 2 and £ G S d_1 . A ssume that X is a generalized excited random walk in 
direction i. Then, there exists v = v(d, K,h,r, A) > such that 

X n ■ £ 

liminf > v a.s. (1-6) 

The proof of Theorem 1 1 . 1 1 rests on two key ingredients: a general result which says that a d-dimensional 
martingale satisfying Condition B and a condition analogous to Condition E should typically visit much 
more than £ 1//2 distinct sites by time t; then, the same kind of result is also obtained for any generalized 
excited random walk with an arbitrary initial configuration of cookies. It is worth noting that the 
approach of this paper could be applied also to models with other rules of assigning the drift to the 
particle. For instance, one can consider a model mentioned in [16j : the random walk receives a push 
in the direction I not at the first visit, but at the kth visit to the site, where k > 1. To study such 
a model, one needs to prove that the set of sites visited at least k times should be sufficiently large. 
However, it is not difficult to do so using (some suitable) uniform ellipticity condition: if the particle 
visits a site, then in the next few instants of time this site will be visited k — 1 times more with a 
uniformly positive probability. 

In this paper, we also consider an excited random walk in an i.i.d. random environment in Z d , 
d > 2, proving a law of large numbers and a central limit theorem for it. Let V be the set of probability 
measures on {±ej, 1 < i < d}. Let M = V N and f2 = . An element u = {u(x),x G Z d } G is 
called an environment. Here, for each x G Z> d , co(x) = {io n (x),n > 0} G M. and 0J n {x) = {co n (x,e) G 
V}. Let P be a probability measure defined on Q under which the random variables {oj(x),x G Z d } 
are i.i.d. Let us stress that we do not assume any independence of the random variables uo n {x), n > 0, 
for a fixed x. We assume that P is uniformly elliptic so that there exists a constant k > such that 
for every n > and 1 < i < d one has that P[u n (0, ±ej) > k] = 1. Furthermore, we assume that P is 
uniformly excited in the direction I G S d_1 , so that there exists a A > such that 

d 

p[^(e;w (0,e;) - eiW (0, -e*)) • £ > A =1, 

and such that for every j > 1 we have that 

d 

P [ ^2(eiU)j(0, ej) - eiU)j(0, -e;)) = =1. 

i=l 

We now define the excited random walk in random environment (ERWRE) as the process defined for 
each n > 0, x G Z rf and e G Z d with |e| = 1, through the transition probabilities, 

k-l 



X k+ i = x + e 



X k = x,^2 Mx^x} = n = io n (x, e 



In other words, whenever the process visits a site x for the first time, it has a mean drift in the 
direction £ which is larger than A; whenever it visits a site x which it already visited before, its 
mean drift is 0. For each environment uj and x G Z, d , we call P w ,x the law of such a process starting 
from x. We define the annealed or averaged law of the excited random walk in random environment 
as P x = J Pu^dP, in opposition to P WiX which is called the quenched law. The second result of this 
paper is the following theorem. 
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Theorem 1.2 Consider the excited random walk in random environment, uniformly excited in the 
direction i £ Then, the following are satisfied. 

(i) (Law of large numbers) . There exists v such that v ■ I > and 

Xn ~. 

> v, Po-a.s. 

n 

(ii) (Central limit theorem). There exists a non- degenerate matrix A such that 

£l ^ 2 {X\ ri e- 1 \ -ne~ l v), 

converges as e — > in P^-law to a d- dimensional Brownian motion with covariance matrix A. 

In the above theorem, we considered the case of nearest-neighbor jumps only for notational conve- 
nience; it extends to the case of uniformly bounded jumps without difficulties (one has to assume 
also that Condition E holds). Observe also that, taking P concentrated in one point (so that the 
environment in all sites is the same), we obtain LLN and CLT for a spatially homogeneous generalized 
excited random walk. 

Let us note that, in the paper [16] transience is proved for an excited random walk in random 
environment using the method of environment viewed from the particle. As explained in [15], this 
implies using regeneration times, a law of large numbers with a velocity which could be possibly equal 
to 0. Nevertheless, we do not see how to use the techniques based on coupling with a simple symmetric 
random walk and tan points, to prove that the expected value of the regeneration times is finite. 

This paper is organized in the following way. First, in Section[2]we define a sequence of regeneration 
times. The key fact about this sequence (which is essential for proving Theorem I l.ip is that the time 
intervals between the regenerations behave in a nice way, see Proposition 12.11 The proof of this 
proposition is rather technical and is postponed to Section 14.21 (generally, in this paper we prefer to 
postpone the proofs of more technical results). In Section [3] we prove Theorem 11.11 and then apply 
the previously developed machinery to the excited random walk in random environment proving 
Theorem ll.2i In Section 14.11 we study typical displacement of excited random walk by time n; these 
estimates are then used in Section f4, 21 It turns our that, to understand what the typical displacement 
of the excited random walk should be, one has to understand the typical behavior of the number 
of different sites visited by time n (i.e., the range of the process). The key result concerning the 
range (Proposition 14. lj ) is stated in Section f4.il without proof. In Section f5.il we use some martingale 
technique to obtain several auxiliary facts, which then are used in Section [5.2l to prove Proposition 14. 11 

2 The renewal structure 

The proof of Theorems II .11 and II .21 uses classical renewal time methods. Let us note that the ERWRE, 
in a fixed environment, is a generalized excited random walk. Hence, here we will focus on the 
construction of the renewal structure for a generalized excited random walk, following the standard 
approach and notation presented in [1] and in the context of Random Walk in Random Environment 
in [13]. Due to the fact that the generalized excited random walk is neither space homogeneous nor 
Markovian, we will need to introduce a general notation, and deviate slightly from the construction 
of [1]. Let I € § rf_1 . We consider a stochastic process (X n ,n > 0) satisfying Conditions B, E and C + , 
with respect to a filtration T n and a direction i € For each u > let 

T u = min{fe > 1 : ■ I > u}. 

Define 

D = inf{m > : X m ■ I < X ■ £}. 



5 



Furthermore, define two sequences of ^-stopping times {S n : n > 0} and {D n : n > 0} as follows. 
We let So = 0, Ro = Xq ■ i and Dq = 0. Next, define by induction in k > 

Sk+i =TR k+ \ 
D k+1 =D o 6 Sk+1 + Sfc+i 
R k+ i =sup{Xj • £ : < i < D k+1 }, 

where 9 is the canonical shift on the space of trajectories. Let 

K = inf{n > : S n < oo, D n = oo}, 

with the convention that k = oo when {n : S n < oo, D n = oo} = 0. We define the first regeneration 
time as 

n = S K . 

We then define by induction on n > 1, the sequence of regeneration times t±, T2, . . . as follows: 

r n +i = r n + Tl(X Tn+ .), 



setting T n+ i = oo when r ra = oo. 

Next, we define = Di 

corresponding to the regeneration time Tfc+i, analogously to the definition of the sequences of stopping 
times Di 
in i > 0, 



Next, we define jD^. = Di and = Si and for each k > 1 two sequences D^ and 

analogously to the definition 
times Di and Si related to t\. For example, S^ = T\, R^ = X T1 ■ £, D^ = and define by induction 



c-(l) _ T 

D« =D o + 5« 

i^i =sup{X i : < » < 

As opposed to the situation which occurs for the standard excited random walk (see [1]), here the 
sequence of regeneration times is not necessarily i.i.d. For each k > 1 and j > such that Sj < oo, 

we need to introduce the u-algebra of events up to time Sj ■ We define Qj as the smallest a-algebra 
containing all sets of the form {j\ < rii} n • • • n {r k < n k } H A, where n\ < ri2 < • • • < n k are integers 

and A G T (k) ■ In Section [H we will prove the following proposition, which will play a key role in 

nfc j 



the proof of Theorem 11.11 

Proposition 2.1 Consider a generalized random walk excited in the direction £, and let (r^, k > 1) be 
the associated sequence of regeneration times. Then, there exist C, a' > such that for every n > 1, 

supP[r fe+1 - T k > n | g { k] ] < C'e~ na ' a.s. 

k>l 

In particular, for every k > 1 we have that r k < oo a.s. 

Now, let us prove the following result which will be useful in the sequel. Throughout, we denote 
by w an element of the space of trajectories (Z d ) N . Furthermore, we define for n > 1, 

D n := inf{m > n : X m ■ I < X n ■ £}. 
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Proposition 2.2 Let A be a Borel subset of (7j d )^. Then, the following statements are satisfied. 

(i) For every k>\, 

oo 

¥[X Tk+ . £ A | g { k) ] = l{^ n} (ro)P[I n+ . e A\D n = 00, T n }. 

n=l 

(ii) For every k,j > 1, 

nx s ( k)+ . e a 1 gf ] 

00 00 

= X X 1 {^=n}( m ) 1 {s (^ =n+m} ( m M X n+m+- £ A \ D n = OO, T n +m\- 
n=l m=l 

Proof of Proposition \2.%\ Since the proof of part (i) is simpler than that of part (ii), we will omit it. 
For part (ii), we only consider the case k = 1 and j = 1, being the case k = 1 and j > 1 similar. 
Using the fact that for every natural n and k > 1, the event {D n = 00} n {n < t^} is measurable, 
the cases when k > 1 can be proved in a similar way. For each n, m > 1, define S n ^ m as the set of 
trajectories {xo, . . . , x n -i,x n ,x n+ i, . . . , x n+m } satisfying the following properties: 

a) 

X n ■ t > SUp X[ • I, 
D<i<n-1 

b) for each / such that < I < n — 1 one has 

min x.i ■ I < xi ■ £, 

T Xv t<i<n-l 

c) one has that 

Xn+m ■ i > X n ■ £ + 1 > SUp X\ ■ t. 

0<l<n+m-l 

These three conditions define the trajectories in S n ^ m as those for which if D n — &® then ^ — ti~\~ rxx 
(and n = n). We will use the notation s n ^ m for an element of iS n ,m- Furthermore, given a trajectory 

w £ (Z rf ) N , we will denote by w n its projection to the first n coordinates. Now note that Q± is 
generated by the disjoint collection of sets of the form 

{-W n+m = Sn^m} n {n = n}, 

where n and m vary over the naturals and s n+m £ <S n ,m- Hence 

00 00 

n* s w + . G ^ I gW] = X 1 {ti =„ } ^ X l {ron+m=Sn+m} P[X n+m+ . £ A J ti = n, w„ +m = s n+m }\. 

Tl=X 772=1 S n + m G(Sn,m 

On the other hand, for each n and m we have that when s n + m £ <S n ,m 

{w n+m = s n+m } n {ti = n} = {ro n+m = s nj7n , Z) n = 00}. 
Therefore, since l {T1=n} {w)l {s (i )=n+m] {w)l {vJn+m=Sn+m} = whenever s n+m £ 5 n , m , we see that 

nx s m + . e A I g^} 
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1 {T 1 =n}( ro )l| S (i) =n+m }(w)P[^n+m+- € A \ D n = OQ,W n+m = S n , r 

71 — 1 TTL — 1 Sn,m€On,m 

oo oo 
n=l m=l 



□ 



3 Proof of the main results 

In this section we will prove Theorems 11.11 and 11.21 
3.1 Proof of Theorem fTTTI 

To prove Theorem ll.il we first prove the following lemma. 

Lemma 3.1 Consider a generalized excited random walk in the direction £. Let (T k ,k > 1) be the 
associated regeneration times. Then, there is a constant C > such that a.s. 

lim sup — < C. 

n— >oo Tl 

Proof. Let C = sup fc>1 E(rfc + i — r k | Gq)\ by Proposition I2.lt we know that C < oo. Let tq = 0. 
Now, consider the process M n = Ylk=o ( r fc+i — r fc — ^( r fe+i — T fc I Go ))> f° r n > 1> which is a martingale 
with respect to the filtration (G^\n > 1). We then have for C > C that 

P[r n > nC] < F[M n > n[C - C')\ < E ^ 



n 4 (C- C") 4 ' 

But, using the fact that M n is a martingale and Proposition 12. 1[ we see that there is a constant C\ > 
such that E[M 4 ] < dn 2 . Hence, 

P[r n > nC] < % 

for some constant C2 > 0, which by Borel-Cantelli proves the lemma. □ 

Let us now see how to deduce Theorem 11.11 from Lemma 13.11 By definition of the regeneration times, 
note that 

liminf^— ->1. (3.1) 

n— >oo n 

For each k > 0, define n k = sup{n > : r n < k}. Since for each n we have T n > n, it follows that 
n k < 00 a.s. Note also that lim^oo n k = 00. Also, by definition of r k and n k we have X k ■ £ > X Tnfc • £, 
so 

t . ,X k -£ . c X T„ k -t . ,n k X Tn ■£ . n k x r„ h ■ I 1 

hmmf — - — = hmmf f = hmmf > hmmf - > — , (3.2) 

fe— ¥00 k k— ¥00 k k~^oo k n k k— >oo T n ,-\.\ n k C 

where C is the constant appearing in Lemma 13.11 and in the last inequality we have used (|3.ip and 
Lemma |3. 11 This proves Theorem 1 1.11 □ 
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3.2 Proof of Theorem Q 

As explained in the first paragraph of Section [21 let us note that for each environment uj, under the 
law Pujfl, the ERWRE has a sequence of regeneration times (r n ,n > 1) which satisfy Propositions 12,11 
andE2J 

Furthermore, as explained e.g. in [T3], within the context of random walk in random environment 
the following proposition is satisfied (the fact that Pq[Dq = oo] > follows from Proposition 14.31 below 
and the observation that a.s. the random walk satisfies conditions B, C + and E): 

Proposition 3.2 Let (r n ,n > 1) be the regeneration times of an ERWRE. 

a) Under the annealed law Pq, t\, T2 — t%, T3 — T2, . . . are independent and T2 — t\,t% — T2, ■ ■ ■ are 
i.i.d. and with the same law as t\ under Pq[ ■ \Dq = 00]. 

b) Under the annealed law Pq, Xr, ATl \,Xfr. +Tl \ AT2 \ — X Tl , -^((.+t 2 )at 3 ) ~~ X T2 , . . . are independent and 
X((. +ri ) Ar2 ) — X T1 ,Xu. +T2 ^ AT3 ^ — X T2 , . . . are i.i.d. with the same law as X(. Ari ) under Pq[ ■ \Dq = 
00]. 

Proposition 12.11 and 13.21 have the following two corollaries. 

Corollary 3.3 Let A be a Borel subset of (Z d ) N . Then for every n > 1, 

Po[X Tn+ . - X Tn G A I gW] = P [X. G A I Dq = 00]. 

Corollary 3.4 Let {r n ,n > 1) be the regeneration times of the ERWRE. Then the following are 
satisfied: 

a) Eq[t1] < 00 and Eq[ti \ Dq = 00] < 00. 

b) E [X^} < 00 and Eq[X\ \ D = 00] < 00. 

Now, using standard methods, one can prove part (i) of Theorem [L2j showing that a.s. 

.. X n E [X Tl \D = w] 
v = hm = : — — = — . 

n-s-oo n Eq[Ti I Dq = OoJ 

Indeed, by Proposition 13.21 and Corollary 13.41 we have that 

lim — = Eq[ti I Dq = 00] and lim — — = Eq[X t1 I Dq = 00] . (3.3) 

n— >oo n n— >oo n 

Then, standard arguments enable us to deduce part (i) of Theorem 11.21 from (|3.3p . The proof of 
part (ii) of Theorem 11.21 follows the methods of e.g. [12], using Corollary 13.41 deducing that the 
covariance matrix of the limiting distribution is given by 

A _ E [(X T1 - nvYjXr, - T lV ) I Dq = OO] 

Eq[tx I Dq = OO] 

4 Displacement estimates and tails of the regeneration times 

In this section we will derive estimates on the displacement of generalized excited random walks 
with an arbitrary initial cookie configuration. This will be used to prove the tail estimates for the 
regeneration times in Proposition 12.11 A key ingredient in the proofs will be estimates on the range 
of the process. 
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4.1 Displacement estimates 

For the sake of completeness and for future reference, we introduce also 

Condition C. Let I € S d_1 . We say that Condition C is satisfied with respect to £ if 

K(X n+ i — X n | F n ) = on {there exists k < n such that X k = X n }, 

and 

E(X n+1 -X n \T n )-e>0 on {X k / X n for all k < n}. 

That is, Condition C does not require that on the first visit to a site the particle gets a uniformly 
positive push in the direction £. 

Now, we need to consider processes starting at an arbitrary cookie environment. 

Conditions Ca and C\. Let t € S^ 1 and A C Z d . We say that condition Ca is satisfied with 
respect to £, if 

E(X n+ i — X n | T n ) =0 on the event {there exists k < n such that X k = X n or X n ^ ^4}, 

and 

E(X n+1 -X n \T n )-£>0 on {X k / X n for all k < n and X n G A}. 
If (in addition to the first display) there exist A > such that 

E(X n+ i - X n | F n ) ■ I > A on {X k ^ X n for all k < n and X n G A}, 

we say that Condition Cj^ holds. 

Note that Condition Ca (C^) becomes Condition C (C + ), if A = 7h d . On the other hand, Condition C^ 
with A = simply means that the process is a d-dimensional martingale. Throughout, given a 
stochastic process (X n ,n > 0) on the lattice Z rf , we denote its range at time n by 

= {x eZ d : X k = x for some < k < n}. 

Let us use also the notation \U\ for the cardinality of U, where f/cZf 

Now, the key fact in this paper is that for any process that satisfies Conditions B, E and C^ with 
an arbitrary A C Z d , the number of distinct sites visited by time n is typically much larger than n 1 / 2 : 

Proposition 4.1 Suppose that Conditions B, E and Ca (for some AcZ d , d>2) hold for a process 
X = (X n , n = 0,1,2 .. .). Then, there exist positive constants a, 71,72 which depend only on d, K,h,r, 
such that 

P[|7^| < n5 +a ] < e" 7in72 (4.1) 

for all n > 1. 

The proof of this proposition is postponed to Section [5j 

Now, let us recall Azuma's inequalities. Let a > 0. If {Z n } ng N is a martingale with respect to 
some filtration, and such that \Z k — Z k _\\ < c a.s., then (cf., for example, Theorem 7.2.1 of pQ) 

2 

P[|Z n -Z | >o] <2exp(-^). (4.2) 

If {Z n }„ e N is a super-martingale, \Z k — Zk-i\ < c a - s -) then (see e.g. Lemma 1 of [LI] ) 

2 

P[Z n - Z > a] < exp ( - ^ ) . (4.3) 
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Let H(a, b) C Z d be defined as 



H(a,b) = {x G Z d : x ■£ G [a, b}}. 

Now, we obtain an important consequence of Proposition I4.lt if the cookies' configuration A is such 
that there are enough cookies around the starting point, then the process is likely to advance in the 
direction £. 

Proposition 4.2 Suppose that the process X satisfies Conditions B, E, CX, and there exists Sq > 
such that for some n > 1 



{Z d \A)r\H\ K - n^ +5 °, -Xn^ +a J 



~ 3 



(4.4) 



where a is from Proposition \4-l\ Then, for some positive constants 73 , 74 that depend only on 
d, K, h, r, A, <5o , we have 

F\x n ■£ < -An^ +a l 
L 3 



< e 



Proof. First, note that, by 



maxl, • £ > -Xn^ +a ,X n ■ £ < -Xn^ +a 



k<n 3 3 

for some C\,C2 > 0. Observe also that, again by (|4.3p . 



< C\ne 



[minX k ■ £ < -n2 +<5 °] < C 3 ne 



-C 4 n 2S 



k<n 

for some C3, C4 > 0. Next, let 

V k = K(X k+ i — X k I J^fc) 
be the (conditional) drift at time k. Then, the process 

n-l 

Y n = X n — T^k 

k=0 

is a martingale with bounded increments. By (|4,4p and condition C^, on the event 
{IK* I > n^ +a ) n \x k G H^- n^ +5 °, ^An5 +Q ) for all k < n} 

we have 

D k ) • £ > ^\J+ a . 

k=0 



Hence, using (|4.2p and Proposition I4.ll we conclude the proof of Proposition I4.2 



(4.5) 



□ 



Remark 4.1 The condition (|4.4p is enough for our needs in this paper, but, in fact, from the proof 
of Proposition |^.g| one can see that it can be relaxed in the following way: if in the strip of width 
0(n2 +a ) (where < a < a) there are not more than 0{n^ +a ) eaten cookies, then the process is likely 
to advance by at least 0{n^ +a ) by time n. 

For each £ G S^" 1 , define the half-space = {x G Z d : x ■ £ > 0}. Next, we prove that if for 
some £ G § rf_1 we know that all the cookies in the half-space are present and that Condition 0,4 is 
satisfied with respect to £, then with uniformly positive probability the process never goes below its 
initial location: 
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Proposition 4.3 Assume Conditions B, E, CX, and suppose that A is such that C A. Then there 
exists ip = ip(d, K, h, r, A) > such that 

F[D = oo] > F[X n -£>0 for all n > 1} > ip. (4.6) 

Proof. Clearly, since on {X n ■ £ > for all n > 1} the process does not see the cookies' configuration 
on Z d \M.£, it is enough to prove this proposition for the case A = Z d . For a (large enough) integer m, 
consider the event 

U = {{X k+1 - X k ) ■ £ > r for all k = 0, . . . , [r^m - 1}; 
observe that X^ r ~i^ m ■ £ > m on Uq. By (jl.4j) we have for any fixed m > 

F[U ] > h^ m . (4.7) 

Let A' = Z d \ {Xo, . . . , Xr r -i-i m _i}, yo = Xr r -i-\ m , and abbreviate W k = X^ r -i-\ m+k , k > 0, so 
that Wo = yo- Observe that, if m is large enough, then the process W — yo satisfies Conditions B 
and E, and A' — yo satisfies (|4,4p for all n > m 2 ~ £ for some small enough 5q. Now, suppose that 
the event Uq occurs and let us fix e such that (2 — e)(i + a) > 1. Denote = 0,mi = m, and 

m/j+i = fm^ 2 e ^2+ a ) £ Qr ^ -> Consider the events 



G k = { min (Wj-Wo)-£> -m k }, 
U h = { W \ml- e \ > m k+l}, k>l. 

Observe that 

oo 

{X n ■ £ > for all n > 1} D ( f) {G k n 17*)) n C/ (4.8) 

fe=i 

(indeed, on G fc n U k -\ we have X n • i > for all n € (m^,m^ £ ]). Also, by (|4T3J) . 

P[G fe |C/ ]>l-m|- E e- 2K2m l, (4.9) 

and, by Proposition 14.21 

P[£4 | Uo] > 1 - e-^ m K~ £)l \ (4.10) 

Since W[r\f =1 {G k C\U k ) \ U ] > l-J2T=i( F i G k I U o]+V[U% \ U )), Proposition IP1 now follows from K7\i 
and (HID. □ 



4.2 Proof of Proposition 12.11 

Here we will prove Proposition 12. l\ following closely [3]. We will need the following result: 

Proposition 4.4 Consider a generalized excited random walk with respect to a filtration (J- k ,k > 0) 
and in the direction £. Let (r k ,k > 1) be the corresponding regeneration times. Then 

(i) there exists a positive constant ip depending only on d, K,h,r, A, such that 

sup p[.of } < oo | gf ] ] < 1 - V; (4.11) 

j,k>l 
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(ii) there exist positive constants 73,74 depending only on d, K, h,r, A, such that 



supl 

k>l 



1 



1 



(X Tk+n -X Tk ).£<^\nl +a gW ' <e-» n74 ; (4.12) 



fm) i/iere exzsi positive constants 75,76 depending only on d, K,h,r, X, such that 

sup P[n < Z>? ) - Sf < 00 I sf] < e~^ 6 . (4.13) 
i,*>i 

Before proving Proposition 14.41 let us see now it implies Proposition 12.11 We follow the proof of 
Proposition 1 in [4]. Let 01,02,03 be positive real numbers such that a\ < g + a and 02 + 03 < a%. 
For each integer n > 0, let u n = [n ai \ , v n = [w a2 J and w n = [n aa J . We now choose n large enough so 
that (K + l)v n (w n + 1) + 2 + K < u n . Let 

A n = {{X Tk+n -X Tk )-£< u n }, B n =f] {Df ) < 00} 

j=0 

and 

F n =\J{w n <D^-Sf <oo}. 
3=0 

We will show that 

A c n r\B^nF^c{T k+1 -T k <n}. (4.14) 
To this end, for each natural n > 17 define 

r n = max{(X,- - X Tk ) ■ t : r k < j <n}. 

On the event A n n B n n C^, we can define 

Af = inf{0 < j < v n : Df ] = 00}, 

(k) (k) (k) 

and it is true that r k +i = S M . Hence, we need to prove that S M — r k < n. Let us set D_( = r k . By 

(k) 

definition we know that D\^_-y < 00. We now write 

M-l 

with the convention ]C7=o = ^- Since, by Condition B, the range of each jump is at most K, we have 
that for each < j < Af-l, r nW -r <» < K{Df ] -Sf ] ). And by definition, for each < j < Af-l, 
we have that r (&) — r (*,) < if + 1. But on the event F£, since for each < j < M — 1 we have 

< 00, it is true that D^ k ' — <w n . It follows that 

r ( fc) < (if + l)v n (w n + 1). 

Since we have chosen n sufficiently large so that (K+l)v n (w n +l)+2+K < u n , we have r D (k) +2+K < 



M-l 



u n . Now, on A n , we have that X Tk+n ■ I — X Tk ■ I > u n . Hence, X Tk+n ■ t — X Tk ■ £ > r g,) + 2 + K 



M-l 
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and the smallest i such that X Tk+ i ■ £ — X Tk ■ £ > r (k) + 1 must be smaller than n. It follows that 



S M — Tfc < n, and this concludes the proof of (|4.14j) . 

Now, let us show that (|4.14|) is enough to prove Proposition 12. 1[ Indeed, by parts (ii) and (Hi) of 
Proposition \4A\ we have that 

¥[A n | g { k) ] < e -T3" 74 . 

and 



(4.15) 
(4.16) 



77 

for some 77 such that < 77 < jq. Furthermore, by part (i) of Proposition 14.41 we see that 

ns n l gk k) ] < (i-vr n - 

It is clear now that the estimates (|4.15j) . (|4.16p and (|4.17p applied to the inclusion (|4.14p . imply the 
statement of Proposition 12.11 



(4.17) 



Proof of Proposition \4-4\ 

Proof of part (i). Let k and j be fixed positive integers. By part (ii) of Proposition 12.21 we have that 



00 00 

OO I gf ] ] = ^ Yl 1 {r k =n}( w ) 1 {s W =n+rn} ( w MDn+m = OO \ D n = 00,7" n+m ]. (4.18) 
n=l m=l 

Now, on the paths such that inf n <j< n+m Xj ■ £ > X n ■ £ (which happens when Tp, = n) we have that, 



in i rx t 1 ^"[Dn+rn — °C | J~n+m] ^ TrorfS I t 1 

P[D n+m = oo | D n = oo,T n+m \ = —^-^ | zp — > r[D n+m = oo | F n+m \. 



F[D n = oo | Fn+m 
Hence, using Proposition 14.31 we get that 

F[D n+m = oo | D n = oo, T n+m ] > if) > 0. 

Substituting (j4"7T9|) into flggD we obtain that 

p[£)( fc ) ~ f r>.( k ) 



(4.19) 



: OO 



n=l m=l 



Proof of part (ii). Note that 



»[(X Tfc+n -X r J-£<Arni- 

oo 



a (fe) 

^0 



1 i 



: Y, l { r k=m }(^W[(X m+ n -X m )-£< X^ +a 
m=l 



OO 



< 



{T fc =m} 



•TO 



_ ( F[D m = oo\T m \ 

oo 



-D m — OO, J~ m 



(X m+n -X m )-£< X^ +a 



m=l 
1 

< ± p -73n 74 



[L> m = oo | T m ] 



-73 n 7 4 



where in the first equality we have used part (i) of Proposition 12.21 i n the second to last inequality 
Proposition 14.21 and in the last step Proposition 14.31 



Proof of part (Hi). This follows from part (ii) in analogy with the proof of Lemma 9 of [I]. 



□ 
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5 On the number of distinct sites visited by the cookie process 

In this section, after obtaining some auxiliary results, we prove Proposition 14.11 

5.1 Some preliminary facts 

Denote by 

n 

L n (m) = l{X,-te[m,m+l)} 
j=0 

the local time on the corresponding strip. Let also 

T§ = min{n > : X n G U} (5.1) 

be the entrance time to set U for the process X. 

In the sequel we will use the following simple facts: if t is a finite stopping time and X is a process 
that satisfies Conditions B, E, and Ca, then the process X o 6 T also satisfies Conditions B, E, and Ca 
(but maybe with different A, which is random and Jv-measurable) . If Y satisfies Conditions B, E, 
and Ca with A = 0, then Y o 9 T also satisfies Conditions B, E, and Ca with A = 0. 

We need the following 

Lemma 5.1 Under Conditions B, E, Ca, for any 5 > there exists a constant such that for all m 
we have 

F[L n (m) > n5+ 25 ] < e~^ n& . 

Proof. Without restricting generality, suppose that m = —1. Denote To = 0, and 

f k+1 = mm{j > f k : X r £e [-1, 0)}. 

With this notation, 

L n (— 1) = maxjfc : < n}. (5-2) 
By Condition E, there exist C\ > and io > 1 such that for any stopping time r 

P[(X r+i0 - X T ) .£ > 2 I T T \ > C 1 . (5.3) 

Using the Optional Stopping Theorem, for any m and for any x such that x ■ £ > 1, we obtain that 

1< ( n l+ 5 + i^)P[r x o0 f <t* ( m0l oJ f ,. [J* .. ,Xf .^ = xl. (5.4) 

Then, by (|5.3p and (|5.4p . for any m it holds that 

PfXa ^-£> for all i < fc < t x o 0+ I J"- 1 > C 2 n - ^ a . 

That is, starting at any y such that y ■ £ £ [—1, 0), by (|5,3|) with a uniformly positive probability the 
particle advances by at least distance 2 in direction I during the first io steps, so that it comes to 
i/(l, +00); then, by (|5.4|) . the particle will visit H{n^ +5 , +00) before coming back to the "negative" 
half-space with probability at least 0(n - 2 -<5 ). But, if the particle managed to visit H(n2 +S , +00), 
by (|4.3p it is quite likely that it will take more than n time units to go back to H(—oo, 0). So, by (|4.3p . 
we have 

P[f k+l0 -f k >n\ F fk ] > C 2 n-l- 8 (l - e - n26 l^) > C 3 rrK 
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Thus, one can write 

P[there exists k < n^ +2S - i such that f k+io -f k >n]>l- e~ Cin \ 

and so, using (|5.2|) . we prove Lemma 15. 11 □ 

Denote by B(x, s) = {y € Z d : \\y — x\\ < s} the discrete ball centered in x and with radius s. 

Consistently with the discussion in Section [H let {Y n } n€ N be a process which satisfies Conditions B, 
E, Ca with A = (i.e., Y is a d-dimensional martingale with uniformly bounded increments and some 
uniform ellipticity) . 

Now, we obtain some properties of the process Y needed in the course of the proof of our results. 
Lemma 5.2 There exist b £ (0, 1) and 72 > (depending only on K, h, r) such that 

E(||y„ +1 || 6 1 ? n ) > ||y„|| 6 i {r?i || >7 , } . (5.5) 

Proof. Observe that, for any 5 > there exists e' > such that for all u £ M with the property \u\ < e' 
and all b £ (^, 1) we have 

(1 + u) m > ! + h u _ (1 + s)^-(l - h -\u 2 . (5.6) 



Now, abbreviate 

Py,y+z — Pp'n+l Y n — Z | J~ n ,Y n — y], 

take y such that ttti < e', and write 
y \\y\\ ' 



\y\\ b ) 



E(||y n+1 || fe - ||y n || fe I T n ,Y n =y) =Y,Py,y+z(\\y + z\\ l 

z 

\y + z|| 2 \V2 



\y\\ b Y. p y^ 



\y\\ 2 



Denote by (p V:Z the angle between y and z regarded as vectors in M. d . By (|5.6p . Condition B, and the 
fact that zPy tV+z = 0, we can write 



E(\\Y n+l \\ b -\\Y n \\ b \Y n = y ) 

^Ew(^ + «-a + *)<i-!)^ 



1 



2 ^ , ll z ||4 



y|| 4 4V 2/ 

^ E P ^+- ll^l 2 2) Nil 2 COg2 <PVr 
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if 3 „ if 



i 



|y||3-6 1 ^ 2 || y ||4-6- 



where Ci and C2 are some (not necessarily positive) constants. Since d > 2 and using uniform 
ellipticity, we obtain that if 5 is small enough and b is close enough to 1, we have for any y 

P V)V+e (| |jz|| 2 - (1 + 5) (l - ^) ||z|| 2 cos 2 <p v Jj >6'>Q 
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(use Condition B and (|1 . 5j) with some £' such that £' -y = 0). Together with the previous computation, 
this concludes the proof of Lemma 15.21 □ 



Next, we prove the following fact (b is from Lemma l5,2p : 

Lemma 5.3 Assume that a process Y satisfies Conditions B, E, Ca with A = 0, and suppose also 
that Yq = xq. Then, for any 5 > there exists 7 3 > such that for all xo,yo £ ^ d an d f or oil n we 
have 

P [E 1 «= y0 }>^ +5 ] <e~^ S . (5.7) 
j=l 

Proof. Without restriction of generality, we may assume that xo = yo = 0. Abbreviate f = 
T z d \B(o 7' +1) anc ^ = ^ m 7^ f° r an 1 < m < where 7 2 is from Lemma [5.21 By uniform 
ellipticity, there exists C\ > such that 

P[V] > Ci. (5.8) 
By the Optional Stopping Theorem and Lemma 15.21 we have 

(72 + 1)' < (7 2 ) b + C 2 {n 1 / 2 + i^) 6 IP[r^^ (0iC2nl/2) o f < rj^ o f | V", Jf] 

where C2 is a (large) constant to be chosen later. This implies that 

P [ T ^\B(0,CW/2) ° ^ < T B(0^) o6 r\V, Ff] > (5.9) 

for some positive C3 depending on Ci- Next we assume that C2 is sufficiently large so that (|4.2p 
implies that for any stopping time f 

P[r y o 0, > n I Ff, Yf = y] > 1 - 2 exp ( - ^^T ) > \ for ^ V e ^ \ ^n 1 / 2 ) (5.10) 

(to reach from y, the martingale Y has to advance by at least C27J 1 / 2 units in some fixed direction). 
Now, fl52|), (pr5]l . and (IBTTTJl) imply that 

P[F m ^ for all m = 1, . . . ,n] > . (5.11) 

Then, proceeding as in the proof of Lemma 15. II (the argument after (|5.4p up to the end of the proof), 
we obtain that (|5.1ip implies (|5.7p . □ 

Next, we prove that the process Y typically hits sets which contain enough points close to the 
starting place of the process: 



Lemma 5.4 Assume that a process Y satisfies Conditions B, E, Ca with A = 0, and suppose that 
Yq = x. Consider an arbitrary 5 > and a set U and suppose that \B(x, m 1 / 2 ) \U\< m 1 -^- 25 , for 
some m. Then, there exists 74 > such that 

P[r£ > m 1 - 6 } < e~^ mS . 

Proof. First, by (|4.2p . we have that 

F[Y k € B{x,m 1/2 ) for all k < m 1 ' 5 ] > 1 - e~ Cm \ 
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Then, by Lemma 15,31 with probability at least 1 — e Cm& by time m 1 5 every site from B(x,m 1 / 2 ) 
will be visited less than to2 +<5 times, so we have 



= \{Y ,...,Y ml .s}\ > ^4 =m 1 -f^ 



with probability at least 1 — e c ' m . To conclude the proof of Lemma 15,4} it remains to observe that, 
since \B(x,m l l 2 ) \ U\ < m 1 ~2~ 2S , on the event 

{| J B(x,m 1 /2)n^ 1 _,|>m 1 -f- 25 } 

we have {y , • • • , Y m is} D U ^ 0. □ 



5.2 Proof of Proposition 14.11 

Fix a £ (0, |) and e > in such a way that (1 — a + e) A (\ + f (1 — 6) — 4e) > ^, where b is from 
Lemma |5.2( also, fix n > 1. In the rest of this section, we will not explicitly indicate the dependence 
on a, b, e, n by sub/superscripts in the notations. Let us denote by 

J ff i = F(2(j-l)nf,2(j + l)nf) 



the corresponding strip of width 4na . We say that the strip Hj is a trap if \TZ^ n > n^ 1 2) 2e . 
Consider the event 

G = {|^| > I n (l-a+s)A(i+f(l-6)-4 £ ) j_ 

We are going to prove that 

¥[G] > 1 - e- CinE/2 , (5.12) 
thus establishing Proposition 14.11 Let us introduce the event 

Gi = {L n (fc) < n^ +£ for all A; € [-Kn,Kn]}. 

By Lemma 15. 11 it holds that 

F[Gi] > 1 - (2Kn + l)e"^ n£/2 . (5.13) 
Next, denote o"o = 0, and, inductively (assuming, of course, that |/i a_e J > 1), 

= min{i > a k + [n a ~ £ J : n £(X,-, n a / 2 )| < n^ 1 ^)-^} (5.14) 

(formally, if such j does not exist, we put <Jk+i = 00). Consider the event (to hit a new point means 
to visit a previously unvisited site) 

£?2 =|at least one new point is hit on each 

of the time intervals [oj— 1, Oj), j = 1, . . . , — n 1_a+e |. 

Now, the key observation is the following: when the process is walking on previously visited sites, it 
has zero drift. So, if we only want to assure that at least one new point it visited, this is equivalent to 
considering the first moment when the process Y (the process without cookies) enters the previously 
unvisited set. Then, by Lemma 15.41 we have 

P[at least one new point is hit on each 
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of the time intervals [aj-i,(Tj),j = 1, . . . , k] > 1 — ke 74 n , 

so we obtain that 

P[G 2 ] > 1 - in 1 - a+e e-T4 n * / ". (5.15) 

Next, assuming that n is so large that 8n 1_e < n/2, let us show that (G\ D G2) C G. Indeed, 
suppose that both Gi and G2 occur, but \TZ^ \ < na + 2 ( 1 ~ b )~ 4e . Denote by 

2(j+l)n a / 2 -l 

Lj = ^ L n (k) 

k=2(j-l)n a / 2 

the total number of visits to Hj. Then, on {|7£^| < na + 2 ( 1_b )~ 4e } the number of traps is at most 
2n2~2~ 2e . On the event Gi, we can write 

J2Ljl {Hj isa t r ap} < 4n* x 2n5-§- 2£ x n5 +£ = 8ra 1_e . 
3 

On the other hand, note that, since for j < n we have 7v^ C 71%, if n B(Xj,n a / 2 )\ > n a ^~^~ 2£ 
then must be in a trap. Since n is such that 8n 1_e < n/2, we obtain that, on the event 

j ^ Ljl{Hj is a trap} < Sn 1 £ | 

j 

we have that cri n i_ a +e < n (indeed, the total time spent in non-traps is at least n/2; on the other 
hand, from the definition (|5.14p one can see that up to the moment we can have at most kn a ~ e 
instances j such that \1Zf Pi B(Xj, n a / 2 )| < n aiyl ~^~ 2£ ). But then, on the event G2 we have that 
\~R-n I > 3n (1 ~" a+e) - So, indeed (Gi n G 2 ) C G, and (I5T2D follows from (^T3l) and 4515)1 . The proof of 
Proposition 14.11 is finished. □ 
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